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Aims The Systematic COronary Risk Evaluation (SCORE) scale assesses 10 year risk of fatal atherosclerotic cardiovascular 

disease (CVD), based on conventional risk factors. The high-risk SCORE version is recommended for Central and 
Eastern Europe and former Soviet Union (CEE/FSU), but its performance has never been systematically assessed in 
the region. We evaluated SCORE performance in two sets of population-based CEE/FSU cohorts. 

Methods The cohorts based on the World Health Organization MONitoringoftrends and determinants in CArdiovascular disease 

and results (MONICA) surveys in the Czech Republic, Poland (Warsaw and Tarnobrzeg), Lithuania (Kaunas), and Russia (Novosi- 

birsk) were followed from the mid-1980s. The Health, Alcohol, and Psychosocial factors in Eastern Europe (HAPIEE) 
study follows Czech, Polish (Krakow), and Russian (Novosibirsk) cohorts from 2002-05. In Cox regression analyses, 
the high-risk SCORE >5% at baseline significantly predicted CVD mortality in both MONICA [n = 15 027; hazard 
ratios (HR), 1.7-6.3] and HAPIEE (n = 20 517; HR, 2.6-10.5) samples. While SCORE calibration was good in most 
MONICA samples (predicted and observed mortality were close), the risk was underestimated in Russia. In HAPIEE, 
the high-risk SCORE overpredicted the estimated 10 year mortality for Czech and Polish samples and adequately pre- 
dicted it for Russia. SCORE discrimination was satisfactory in both MONICA and HAPIEE. 

Conclusion The high-risk SCORE underestimated the fatal CVD risk in Russian MONICA but performed well in most MONICA 

samples and Russian HAPIEE. This SCORE version might overestimate the risk in contemporary Czech and Polish popu- 
lations. 

Keywords Cardiovascular mortality • Cardiovascular risk factors • SCORE risk function • Risk prediction • Central and 

Eastern Europe • Former Soviet Union 



Introduction 

Cardiovascular disease (CVD) is the world's leading cause of 
mortality, morbidity, and disability.^'^ Numerous algorithms use 



combinations of conventional risk factors to identify individuals at 
higher risk of CVD, who are most likely to benefit from preventive 
measures.^'^ The existing risk scores were mostly derived from 
Western European and North American cohorts, and their 
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prognostic accuracy might differ in other populations. ' The most 
widely used instruments are the Framingham risl< model* and the Sys- 
tematic COronary Risk Evaluation (SCORE) scale/ The latter, based 
on prospective datafrom 12 European cohorts, estimates 10 year risk 
of fatal CVD and uses age, sex, blood lipids, blood pressure, and 
smoking as risk predictors. One component of the SCORE model 
defines the shape of the baseline survival function, separately for 
men and v/omen, while the other calculates relative risks for each 
risk factor. The effects of risk factors are considered to be similar in 
both genders, across countries, and over time.^ Two SCORE ver- 
sions were created for high- and low-risk European countries. 

While CVD mortality has recently declined in most Central and 
Eastern European (CEE) countries, it is still high in almost all of the 
former Soviet Union (FSU).^ The latest guidelines by the European 
Society of Cardiology (ESC) acknowledge the heterogeneity of the 
background CVD risk in this region but still provide only one 
version of the high-risk SCORE, recommended for use in all CEE/ 
FSU populations.^ It is unclear how well SCORE performs in CEE/ 
FSU, as it was derived without reference to the local data^ and has 
never been properly recalibrated for this area. 

Our study aimed to assess the prognostic performance of the high- 
risk SCORE in CEE/FSU, using two sets of population-based cohorts 
from four countries in the region. 
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Study population and samples 

We used the datafrom two international studies: the World Health Or- 
ganization (WHO) MONitoring of trends and determinants in CVD 
(f^ONlCA) Project'''"' and the Health, Alcohol, and Psychosocial 
factors in Eastern Europe (HAPIEE) study." 

The WHO [MONICA Project monitored the trends in CVD rates and 
risk factors in 38 populations from the mid-1980s to at least the 
mid-1 990s.''^° Risk factors were assessed in random population 
samples of men and women aged 35-64; some of these samples were fol- 
lowed for mortality. We obtained the baseline data and the data on the 
subsequent 10 year mortality from the following [MONICA samples: 
the Czech sample from six country districts, examined in 1992; Polish 
Warsaw and Tarnobrzeg samples screened in 1983-84 and 1987-89; 
Lithuanian Kaunas samples examined in 1983-85, 1986-87, and 
1992-93; and Russian Novosibirsk samples screened in 1985-86, 
1988-89, and 1994-95. Numbers of subjects and response rates are 
presented in Table I. At baseline, participants completed a questionnaire 
survey, underwent a clinical examination, and provided a blood sample. 
The mortality follow-up used the data from national and local mortality 
registers.' 

HAPIEE is a multi-centre study of CVD and other chronic conditions in 
CEE/FSU." It follows random population samples of men and women, 
aged 45-69 at baseline (2002-05), from the Czech Republic (Havii'ov/ 
Karvina, Hradec Kralove, jihlava, Kromer^iz, Liberec, and Usti nad 
Labem), Poland (Krakow), Russia (Novosibirsk), and Lithuania 
(Kaunas). The four cohorts have been followed for cause-specific mortal- 
ity and non-fatal CVD. As the Lithuanian cohort entered the study later 
and had fewer CVD deaths, we analysed only Czech, Polish, and 
Russian data. The baseline data collection included a questionnaire 
survey and a physical examination, with afasting venous blood sample col- 
lection. Mortality data for the median follow-up period of 4.6-6.2 years 
(Table J) come from national (the Czech Republic) and local (Poland and 
Russia) registers." 
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As SCORE predicts the risl< of cardiovascular mortality in individuals 
over 40 and without pre-existing atherosclerotic CVD,^'^ we excluded 
subjects with a self-reported history or medical evidence of myocardial 
infarction, angina, or stroke and those aged <40 years at baseline. We 
also excluded individuals with missing values of the risk factors, which 
are incorporated in SCORE. In Czech and Polish HAPIEE samples, the 
study questionnaire was completed at home, prior to medical examin- 
ation in a clinic. This explains the smaller proportion of Czech and 
Polish participants with non-missing values of SCORE components. 
The sizes of our analytical samples (15 027 MONICA and 20 517 
HAPIEE participants) are presented in Table 1. 

The MONICA study protocol was approved by the local ethics com- 
mittees in each participating country.' The HAPIEE study protocol was 
approved by the UCL/UCLH ethics committee and by the local ethics 
committees at each study centre." All participants provided informed 
consent. 

Measurements 

The SCORE risk predictors include age, sex, smoking status, total choles- 
terol (TC), and systolic blood pressure (SBP). In MONICA and HAPIEE, 
the data on self-reported smoking status came from the baseline standard 
questionnaire.'"" In line with the SCORE criteria,' participants current- 
ly and regularly smoking at least one cigarette per day were regarded as 
current smokers; never and ex-smokers were considered non-smokers. 
SBP measurement was performed after a 5 min rest, in a quiet room with 
comfortable temperature, in a sitting position, on the right arm, with a 2 
min interval between measurements, using a standard mercury sphygmo- 
manometer (MONICA) or a digital blood pressure monitor Omron M5-I 
(HAPIEE).''" TC concentration in fasting venous blood was measured 
with a direct Liebermann-Burchard method in Polish and Russian 
MONICA and with an enzymatic method in all other samples.''" All 
assay methods were calibrated, and all laboratories were subjected to ex- 
tensive quality control. In agreement with SCORE end-points,' the study 
outcome was coronary or non-coronary atherosclerotic cardiovascular 
death. 

Statistical analyses 

The high-risk version of SCORE, recommended by the ESCforCEE/FSU 
populations,^ was used to predict the risk of fatal atherosclerotic CVD in 
all MONICA and HAPIEE samples, as the recently introduced Czech and 
Polish SCORE versions lack a detailed description of their development 
and recalibration.^^'^^ For comparison, the performance of the low-risk 
SCORE was also investigated. 

The prognostic performance of risk prediction scales, such as SCORE, 
could be assessed via calibration and discrimination. ^'''^^ Calibration 
reflects how close predicted and observed risks are, with a 
predicted-to-observed (P/O) risk ratio of 1.0 indicating perfect calibra- 
tion. In our samples, particularly in female ones, a substantial proportion 
of individuals had the same, relatively low risk levels; therefore, we 
focused on P/O ratios as the preferred calibration measure. Discrimin- 
ation is the model's ability to separate participants who will experience 
events (such as fatal CVD) during the follow-up from those who will 
remain event-free. The typically used threshold measures of discrimin- 
ation include sensitivity, specificity, positive predictive value (PPV), and 
negative predictive value (NPV) for a particular risk cut-off (5% for 
SCORE). Summary measures of discrimination include the area under 
the receiver operating characteristic curve (AUROC) and its equivalent 
for survival models, Harrell's C-statistic.^' AUROC plots the model's 
sensitivity against '1 — specificity' across all consecutive cut-offs. 
AUROC/C-statistic values of 0.5 and 1.0 indicate minimal and ideal dis- 
crimination, respectively. 



Our analyses of SCORE prognostic ability were performed separately 
for men and women in each MONICA and HAPIEE sample and included 
the following steps. First, we investigated the role of SCORE as a fatal 
CVD predictor, using Cox regression models. Second, we assessed 
SCORE calibration, calculating P/O risk ratios for MONICA. For 
HAPIEE, we estimated 10 year levels of atherosclerotic CVD mortality 
and compared SCORE levels to these estimates, in orderto approximate 
the 10 year SCORE calibration. Finally, we assessed SCORE discrimin- 
ation by calculating its sensitivity, specificity, PPV, NPV, and Harrell's C. 

The use of Cox proportional hazards regression models was justified 
by the high P-values in Schoenfeld's test across all the samples. The data 
from all MONICA waves were pooled within samples, because the 
SCORE-fatal CVD association showed no evidence of confounding by 
or statistical interaction with the study wave. The estimation of 10 year 
CVD mortality for HAPIEE was based on the mortality patterns in 
MONICA samples from respective countries. We assumed that the 
ratio between the death numbers registered at a pre-specified cut-off 
point (the follow-up time in complete years; six, five, and four years for 
Czech, Polish, and Russian HAPIEE, respectively) and the death 
numbers observed during the 10 year follow-up would be similar for 
MONICA and HAPIEE subjects from the same country. These ratios 
were separately calculated for Czech, Polish (Warsaw), and Russian 
MONICA men and women and projected onto the currently observed 
numbers of cardiovascular deaths in HAPIEE samples, in order to 
provide estimates of the 10 year CVD mortality. These estimates were 
then used for the analyses of the expected 10 year SCORE calibration 
in HAPIEE. Two-sided P-values <0.05 were used to indicate statistical 
significance. All statistical analyses were performed using Stata/IC 1 1 .0 
(StataCorp LP, Texas, USA). 

Results 

Baseline sample characteristics are presented in Table 2. The mean 
age of MONICA participants was close to 52 years, compared with 
57 years in HAPIEE. In both studies, the sizes of the five-year age 
groups were relatively similar. Smoking prevalence was high in both 
studies, with the exception of MONICA women from Tarnobrzeg, 
Kaunas, and Novosibirsk. Czech and Polish HAPIEE men smoked 
less than their MONICA peers. In contrast, among Russian women, 
smoking prevalence was higher in HAPIEE than in MONICA. In 
both studies, mean TC levels were close to 6 mmol/L and tended 
to be slightly higher in women. The highest mean SBP levels, exceed- 
ing 140 mm Hg, were observed for MONICA participants from 
Warsaw and Czech HAPIEE men. 

SCORE as a CVD mortality predictor 

In most MONICA samples, the high-risk SCORE > 5% at baseline was 
significantly associated with the 10 year risk of atherosclerotic CVD 
mortality {Figure 1). The hazard ratios (HR) varied from 1.7 in 
Warsaw women to 6.3 in women from Novosibirsk. In HAPIEE, 
the baseline SCORE was a significant predictor of fatal CVD over 
the subsequent 4.5-6 years (HR, 2.6-10.5). 

SCORE calibration 

In all male MONICA samples, mean SCORE-predicted risk levels 
were relatively high (>5%); for women, predicted risk was consider- 
ably lower and approached 2% {Table 3). Among MONICA men, the 
percentage of atherosclerotic CVD deaths registered over 10 years 
was highest in Novosibirsk and lowest in Kaunas. In women, the 
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Table 2 Sample characteristics 



Categories 


MONICA men 








H API EE men 








CZ 


PL-W 


PL-T 


LT 


RU 


CZ 


PL-K 


RU 


M 


636 


1253 


1 zo/ 


1 D3 1 


ZJ/ D 


ZDJ 7 




JZ^O 


Mea.n 3gG (SD), years 


50.8 (7.1) 


51.9 (7.0) 


DZ.D \o.of 






CO fi ('7 1\ 


^7 1 (7 


1:7 c (7 m 


Age groups, % 


















AO Ad 


27.0 


21.6 


17 4 


Zj.O 


17 7 
1 /./ 








45-49 


22.5 


20.8 


20.8 


19.3 


22.6 


17.3 


20.4 


1 8.9 


50-54 


21.1 


20.0 


21.6 


18.1 


20.8 


19.6 


21.7 


21.3 


55-59 


15.9 


22.5 


23.2 


22.9 


23.1 


20.7 


21.4 


21.6 


60-64 


13.5 


15.1 


17.0 


15.9 


15.8 


21.6 


18.3 


18.2 


03 -\- 












20.8 


18.2 


20 0 


Current smoking, % 


40.3 


52.5 


56.3 


35.1 


53.1 


26.6 


32.9 


51.0 


Mf^^nTC f^D^ mmr»l/l 


6.2(1.3) 


5.6(1.0) 


5 5 (1 0) 


6 0(1 2) 


3.3 ( I.Z_) 


5.7(1.0) 


5.8(1.1) 


6 0(1 2) 


Mean SBP (SD), mm Hg 


139.0 (20.7) 


142.2 (23.8) 


136.6 (21.2) 


137.3 (20.0) 


136.3 (20.2) 


143.8(18.4) 


141.6 (20.2) 


141.6 (22.7) 




MONICA women 








HAPIEE women 






CZ 


PL-W 


PL-T 


LT 


RU 


CZ 


PL-K 


RU 


M 

J V 


704 


1151 


1 ^oz 


1 DJU 


0^77 
ZD/ / 


3359 


3753 


4044 


Mean age (SD), years 


51.2 (7.2) 


51.8 (7.0) 


4 /z q\ 




jz.z -U^ 


57.4 (7.1) 


56.6 (6.9) 


^7 "i (7 ^\ 


Age groups, % 




















24.0 


21.8 


1 O.J 


04 A 


1Q 4 

1 7.T 








45-49 


24.9 


21.6 


21.6 


21.0 


22.0 


19.6 


22.8 


20.6 


50-54 


17.6 


20.4 


21.4 


19.6 


20.8 


21.2 


23.4 


20.8 


55-59 


18.2 


20.9 


21.1 


19.3 


20.5 


18.2 


20.6 


21.8 


60-64 


15.3 


15.3 


17.6 


15.5 


17.3 


23.7 


17.7 


17.2 


65+ 












17.3 


15.5 


19.6 


Current smoking, % 


20.6 


31.2 


7.5 


4.2 


3.4 


21.0 


25.1 


10.1 


Mean TC (SD), mmol/L 


6.3 (1.3) 


5.7(1.0) 


5.7(1.1) 


6.3 (1.2) 


5.9(1.3) 


5.9(1.0) 


5.9(1.1) 


6.5 (1.3) 


Mean SBP (SD), mm Hg 


137.7 (21.7) 


142.6 (25.1) 


141.6 (24.3) 


137.3 (22.7) 


138.5(22.6) 


134.2(19.4) 


133.2 (20.8) 


141.6(25.7) 



CZ, Czech Republic; LT, Lithuania; PL-K, Poland (Krakow); PL-T, Poland (Tarnobrzeg); PL-W, Poland (Warsaw); RU, Russia. SBP systolic blood pressure; SD. standard deviation; 
TC, total cholesterol. 



observed risk of fatal CVD was half of that in men from the respective 
samples. While most ratios of predicted and observed (P/O) CVD 
mortality were close to 1.0, the risk was markedly underestimated 
for Russian men and women. 

In each male HAPIEE sample, mean predicted levels of 10 year fatal 
CVD exceeded 5%; in women, the predicted risk was three times 
lower. The percentage of CVD deaths registered in Russian men 
was two to three times higher than among their Czech and Polish 
peers; the observed cardiovascular mortality levels in women were 
lower but reflected the same ranking. For the currently available 
data on fatal CVD, all P/O ratios exceeded 1.0, while the magnitude 
of risk overprediction was smaller for Russian vs. Czech and Polish 
HAPIEE. 

As SCORE predicts the 1 0 year risk of atherosclerotic cardiovas- 
cular mortality, we estimated the expected 10 year levels of fatal 
CVD, in orderto assess SCORE calibration in HAPIEE. The estimated 
percentage of deaths for Czech and Polish HAPIEE was noticeably 
lower than the 10 year mortality levels for the respective 



MONICA samples. In contrast, the estimated percentage for 
Russian HAPIEE was slightly higher than the fatal CVD levels in 
Russian MONICA {Table 3). This difference possibly reflects the het- 
erogeneous CVD trends across CEE/FSU in the last two decades.^ In 
agreement with the current discrepancies between Russian vs. Czech 
and Polish national mortality rates,® our fatal CVD estimates were at 
least three times higher in Russian HAPIEE participants than in their 
Czech and Polish peers. Based on the ratios of predicted- 
to-estimated (P/E) mortality {Table 3), the high-risk SCORE demon- 
strated at least a two-fold overprediction of the estimated mortality 
for Czech and Polish HAPIEE, while the agreement between the pre- 
dicted and estimated risk was good for Russian HAPIEE. The low-risk 
SCORE version also overpredicted 10 year estimated mortality in 
Czech and Polish HAPIEE (respective P/E ratios 1.2-1.4; see Supple- 
mentary material online, Table), but to a lesser extent than the 
high-risk SCORE. Among Russian participants, the low-risk SCORE 
predicted only one-half of the estimated mortality (P/E ratios 0.5- 
0.6; see Supplementary material online, Table). 
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Sample 

MONICA men 

cz 

PL-W 
PL-T 
LT 
RU 



HAPIEE men 
cz 

PL-K 
RU 



HR (95% CI) 



5.32 (2.30-12.30) 
4.50 (2.68-7.56) 
3.06 (1.77-5.29) 
3.99 (2.24-7.10) 
2.66(1.96-3.62) 



10.51 (2.53^3.71) 
2.56(1.11-5.87) 
7.63 (3.35-17.40) 



I I I I I I 

.5 1 2 4 8 16 32 64 
Hazard ratio 



Sample 

MONICA women 
cz 

PL-W 
PL-T 
LT 
RU 



HAPIEE women 

cz 

PL-K 
RU 



HR (95% CI) 



5.02 (1.64-15.36) 
1.70 (0.57-5.06) 
4.15 (1.49-11.52) 
5.07 (2.20-11.66) 
6.32 (4.08-9.79) 



3.59 (1.44-8.91) 
8.79 (3.19-24.18) 
7.36 (3.77-14.38) 



n I I I I 

.5 1 2 4 8 16 32 
Hazard ratio 



Figure I The high-risk SCORE (>5 vs. <5%) and atherosclerotic cardiovascular mortality in MONICA and HAPIEE men (A) and women (6) 
hazard ratios (HR) and 95% confidence intervals (CI). CZ, Czech Republic; LT, Lithuania; PL-K, Poland (Krakow); PL-T, Poland (Tarnobrzeg); 
PL-W, Poland (Warsaw); RU, Russia. 



SCORE discrimination 

Sensitivity of the high-risk SCORE was relatively high in all male 
MONICA and HAPIEE samples, whereas its specificity was some- 
what lower; the opposite was true for MONICA and HAPIEE 
women {Table 3). Due to the low outcome frequency, PPV values 
were also low across all the samples; in contrast, NPV values 
exceeded 0.9. All Harrell's C-values were over 0.50 and were 
highest for Czech men and Russian women in MONICA and for 
Czech men and Polish women in HAPIEE. A direct comparison of 
SCORE discrimination in MONICA vs. HAPIEE was not possible, 
due to the current difference in the follow-up length. However, 
SCORE sensitivity appeared higher and specificity lower for most 
HAPIEE samples, compared with respective MONICA samples. 

Discussion 

To the best of our knowledge, this is the first attempt to assess the 
SCORE prognostic performance in CEE/FSU. As expected, the high- 
risk SCORE was a significant risk predictor in both MONICA and 
HAPIEE samples, which are the best available approximations of 
the national levels of cardiovascular risk factors and fatal CVD for 
the 1980s to 2000s. SCORE calibration was good in MONICA, 
with the exception of Russia where fatal CVD was substantially 



underpredicted. This primarily reflects the very high baseline risk: 
Russia is now regarded by the ESC as a 'very- high -risk country', al- 
though no relevant SCORE version has yet been provided.^ It is 
also possible that the very high mortality risk in Russian MONICA 
was partly influenced by the recent mortality fluctuations.® In 
HAPIEE, the comparison between the estimated 10 year CVD mor- 
tality and the SCORE predictions demonstrated that better calibra- 
tion was achieved by the high-risk SCORE for Russian samples and 
the low-risk SCORE for Czech and Polish samples. The high-risk 
SCORE discrimination was satisfactory in MONICA and HAPIEE. 

Strengths and limitations 

Several methodological issues need to be considered when inter- 
preting our findings. First, we used the data from two separate 
studies, which covered different historical periods. As CVD trends 
in CEE/FSU have diverged after 1990, and Russian cardiovascular 
mortality levels have shown large temporal fluctuations, the cohort 
study estimates of a longer-term mortality risk may be an imperfect 
approximation of national rates. Second, while the participating 
cohorts are not nationally representative, they are the best available 
sources of data, and their ranking by fatal CVD levels reflects 
between-country differences in cardiovascular mortality. Third, 
due to a shorter follow-up, the 10 year risk of CVD death in 
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Table 3 Prognostic performance of the high-risk SCORE (>5 vs. <5%) 



■ 





MONICA men 








HAPIEE men 








CZ 


PL-W 


PL-T 


LT 


RU 


CZ 


PL-K 


RU 


Predicted (P) deaths, N (%) 


33.5 (5.26) 


72.4 (5.78) 


69.0 (5.43) 


83.1 (5.03) 


138.1 (5.36) 


199.7 (7.51) 


254.7 (7.37) 


294.4 (9.07) 


Observed (O) deaths, N (%) 


32 (5.03) 


86 (6.68) 


62 (4.89) 


58(3.51) 


181 (7.03) 


37 (1.39) 


34 (0.98) 


105 (3.23) 


P/O ratio 


1.05 


0.87 


1.11 


1.43 


0.76 


5.40 


7.52 


2.81 


Estimated (E) deaths, N (%)* 












74.0 (2.78) 


94.2 (2.73) 


279.3 (8.60) 


P/E ratio 












2.70 


2.70 


1.06 


Sensitivity 


0.78 


0.79 


0.71 


0.72 


0.65 


0.95 


0.79 


0.94 


Specificity 


0.59 


0.54 


0.56 


0.60 


0.58 


0.37 


0.39 


0.33 


DD\/ 
rr V 


0.09 


0.11 


U.Uo 


U.Ub 


U. 1 1 


0.02 


0.01 


U.Uj 


KIP\/ 
INr V 


0.98 


0.97 


U.7 / 


U. 70 


U.70 


0.99 


0.99 


U.77 


Harreli's C 


0.69 


0.67 


0.63 


0.67 


0.62 


0.66 


0.60 


0.63 




MONICA women 








HAPIEE women 






CZ 


PL-W 


PL-T 


LT 


RU 


CZ 


PL-K 


RU 


Predicted (P) deaths, N (%) 


12.5 (1.78) 


22.6(1.96) 


24.6(1.68) 


26.4(1.60) 


44.7(1.67) 


85.0 (2.53) 


92.0 (2.45) 


124.6(3.08) 


Observed (O) deaths, N (%) 


13 (1.85) 


21 (1.82) 


19(1.30) 


26(1.58) 


86 (3.21) 


19 (0.57) 


16(0.43) 


42(1.04) 


P/O ratio 


0.96 


1.08 


1.29 


1.01 


0.52 


4.44 


5.70 


2.96 


Estimated (E) deaths, N (%)* 












41.2(1.23) 


37.3 (0.99) 


139.0 (3.44) 


P/E ratio 












2.06 


2.48 


0.90 


Sensitivity 


0.39 


0.19 


0.26 


0.31 


0.37 


0.42 


0.63 


0.71 


Specificity 


0.89 


0.88 


0.92 


0.92 


0.92 


0.83 


0.84 


0.76 


PPV 


0.06 


0.03 


0.04 


0.06 


0.13 


0.01 


0.02 


0.03 


NPV 


0.99 


0.98 


0.99 


0.99 


0.98 


0.99 


0.99 


0.99 


Harreli's C 


0.64 


0.54 


0.59 


0.61 


0.64 


0.63 


0.74 


0.74 



CZ, Czech Republic; LT, Lithuania; PL-K, Poland (Krakow); PL-T, Poland (Tarnobrzeg); PL-W, Poland (Warsaw); RU, Russia. CI, confidence interval; HR, hazard ratio; NNR negative 

predictive value; PPV, positive predictive value. 

*MONICA-based estimations of 10 year CVD mortality in HAPPIEE. 



HAPIEE v^'as estimated. We compared two estimation approaches — 
one based on the MONICA patterns of cardiovascular mortality and 
the other based on the exponential survival model^'' (not shown) — 
which produced similar results. Fourth, the comparability of 
MONICA and HAPIEE data was high, as the protocols of baseline 
survey, physical examination, and mortality follow-up were similar. 
Fifth, as in most studies, MONICA and HAPIEE participants were 
likely to be healthier than non-responders.This potential discrepancy 
could be enhanced by the complete case analyses and dilute the as- 
sociation of interest. The available multiple imputation methods 
employ the assumption of data missing (completely) at 
random,^®'^' which was not the case for our samples. Moreover, 
the Cox regression results across the samples with the highest 
SCORE missingness were similar for complete and multiply-imputed 
data (not presented). Sixth, some context-specific misclassification 
of outcomes within the broad category of atherosclerotic CVD 
deaths might occur, but it was unlikely to affect the associations of 
interest. Finally, SCORE, like most other risk scales, provides risk 
point estimates without confidence intervals and does not account 
for SBP and TC regression to the mean or for CVD treatment 
effects. However, this single-estimate approach is user-friendly and 
clinically applicable. 



Consistency with other studies 

The validity of our results, despite the above-mentioned potential 
limitations, is supported by the fact that the levels of major risk 
factors and CVD mortality in MONICA and HAPIEE samples were 
consistent with the respective national cross-sectional estimates 
and trends, presented in the WHO Global InfoBase'^^ and WHO sys- 
tematic reviews.'^^''^'^ The association between baseline SCORE and 
fatal CVD was statistically significant in both MONICA and 
HAPIEE. To the best of our knowledge, only two other studies 
have reported the magnitude of the SCORE-CVD association. For 
middle-aged Austrians, the strength of a significant link between con- 
tinuous SCORE and 10 year CVD mortality was reported only after 
adjustment for several covariates.'^^ Among adults participating in the 
Greek ATTICA study, HellenicSCORE levels were significantly asso- 
ciated with the five-year risk of incident CVD.^^ While the direct 
comparison of these results is problematic, the reported HR 
values'^^''^^ are close to the estimates for high-risk continuous 
SCORE in MONICA and HAPIEE (not presented). 

It is difficult to compare our findings on SCORE calibration to 
other CEE/FSU data, due to the above-mentioned lack of similar 
local studies. However, our results are consistent with the evidence 
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from Western studies, which suggest that original and recalibrated 
SCORE versions tend to overpredict risk in populations w/ith declin- 
ing CVD rates.^^'^^"^'' Our data on SCORE discrimination also agree 
with the results for Western populations. In particular, similar to the 
findings for MONICA and HAPIEE men, SCORE sensitivity was 
higher than its specificity across the high-risk SCORE Project 
cohorts^ and among middle-aged Belgians.'^® In agreement with our 
results for MONICA and HAPIEE women, lower sensitivity and 
higher specificity of SCORE were demonstrated for the low-risk 
SCORE Project cohorts^ and in middle-aged adults from Finland,'^' 
Iceland,^^ Spain,^° and Austria.^^ Low SCORE PPVs were observed 
not only in MONICA and HAPIEE but also in middle-aged Spaniards^" 
and Austrians.^^ The Harrell's C-values in MONICA and HAPIEE 
were close to AUROC values reported for the high- and low-risk 
SCORE Project cohorts^ and middle-aged adults from Norway,^^ 
Iceland,^^ and Austria.^"^ However, only in two of our samples 
(Polish and Russian HAPIEE women), Harrell's C-values exceeded 
0.70, which suggests only moderate discrimination. 

To summarize, the high-risk SCORE was a significant predictor of 
fatal atherosclerotic CVD in MONICA and HAPIEE, but it underpre- 
dicted the risk in Russian MONICA and could overestimate the risk in 
Czech and Polish HAPIEE. These findings have several implications. 
First, the high-risk SCORE can be still used for populations with 
high cardiovascular mortality levels, such as Russia. For countries 
where fatal CVD is declining, such as the Czech Republic and 
Poland, the low-risk SCORE might be preferable. A longer-term so- 
lution is SCORE recalibration for specific CEE/FSU populations, using 
local levels of CVD mortality and risk factors. Second, SCORE per- 
formance might benefit from the model's extension by additional 
risk determinants,^^ such as socioeconomic parameters or haz- 
ardous drinking characteristics. Third, our study has reemphasized 
the importance of conventional risk factors for CVD prediction 
and prevention. Controlling these factors in higher-risk groups and 
individuals and across whole populations will reduce the burden of 
CVD in CEE/FSU and prevent the reversal of declining CVD rates 
elsewhere.^'^'^^ Finally, as demonstrated by a steady decline in cardio- 
vascular mortality across most Western populations over the last 50 
years and, more recently, by the positive dynamic of Czech and Polish 
CVD trends,® the task of reducing CVD burden in CEE and particu- 
larly FSU is challenging but nonetheless feasible. 

Supplementary material 

Supplementary material is available at European Heart Journal online. 
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